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ESTABLISHING  THE  CREDIBILITY 
OF  BIOLOGICAL  DATA 


Since  1988.  staft'  at  the  Dorset  Research  Centre  have 
collected  chemical  and  biological  data  as  part  of  a 
federal/provincial  programme  to  monitor  the  reco\er\"  of 
lakes  and  rivers  due  to  reductions  in  the  long-range  transport  of 
airborne  pollutants.  Biological  data  are  often  sensitive  indicators 
of  impaiied  water  quality  because  the  biota  integrate  the  impacts 
(if  man\  stressors  over  time  and  space.  By  contrast,  atypical 
chemical  events  may  be  missed  despite  intensive  sampling  because 
unusual  events  are  infrequent  and  often  span  relati\'ely  .short  time 
periods.  Moreover,  the  wrong  chemicals  or  stressors  may  be 
measured. 

In  lakes  and  rivers,  biological  assessments  Irequently  invohe 
collections  of  bottom-dwelling  invertebrates.  The  resultant  counts 
of  the  difl'erent  species  from  each  sampling  area  comprise  the  raw 
data  that  are  summarized  into  indices  such  as  the  total  number  of 
species,  the  total  number  of  individuals,  and  so  on.  Unlike 
assessments  based  on  \\ater  and  sediment  chemistry,  guidelines 
and  standards  for  biological  indices  are  generally  lacking. 
Consequently  biological  data  are  evaluated  by  comparison  to 
relatively  unimpacted  or  control  locations.  Because  natural 
variabihty  aflects  these  t)pes  of  comparisons,  the  credibility  of  the 
results  can  be  challenged. 

Unlike  chemical  analyses  where  instruments  are  routinely 
calibrated  and  data  are  verified  with  samples  of  known 
concentrations,  quahty  assurance  and  quality  control  protocols  (i.e., 
Q.VQC)  for  biological  data  are  less  common.  Quality  assurance 
requires  dociunented  standard  operating  procedures,  plus  data 
recording,  management  and  verification  protocols,  as  well  as 
regular  performance  evaluations.  Quality  control  provides  data 
quality  objectives  tliat  specify  data  acciu-acy,  precision  and 
completeness   to   guarantee   that   the   resultant   data   are   truly 


representative  and  comparable.  When  used  together.  QA/QC 
methods  ensure  data  integiit)'  and  crcdibilit}'.  Although  quality 
assurance  protocols  are  used  in  biological  assessments,  quality 
control  procedures  that  establish  data  accuracy  and  precision  are 
often  lacking. 


In  a  recent  report,  the  credibihtj  of  the  data  used  in  biological 
assessments  has  been  evaluated.  The  data  in  question 
originated  from  repeated  assessments  of  bottom-dwelling 
invertebrates  found  in  the  shallow  areas  of  s-mall  lakes  Each  fall, 
staff  at  the  Dorset  Research  Centre  sample  the  nearshorc 
invertebrates  in  five  small  lakes  in  order  to  detect  anticipated 
changes  in  the  health  of  representative  lakes  in  south-central 
Ontario.  Standard  operating  procedures  were  de\  eloped  through 
con-sultation  between  federal  and  provincial  agencies  in  the  Long- 
Range  fransport  of  Airborne  Pollutants  (LR'IAP)  Progranune. 
Members  of  this  programme  use  the  resultant  standard  operating 
procedures  to  collect  data  from  lakes  and  rivers  in  sl\  areas  of 
eastern  Canada.  The  data  are  stored  in  a  shared  database  that  wiU 
be  used  to  examine  local  and  regional  responses  to  emission 
reductions.  An  additional  objective  of  the  Dorset  study  was  to 
develop  simple  qualit}  control  (QC)  procedures  to  estabhsh  the 
reliability  and  hence,  credibility  of  the  biological  data. 

In  chemical  analyses,  QC  checks  include  the  regular  use  of 
standards  of  known  concentrations,  plus  blank,  split  and  spiked 
samples.  Because  samples  of  invertebrates  aie  relatively  fragile, 
standards,  blanks  and  spiked  samples  are  ahnost  impossible  to 
manufacture.  ,'\s  a  result,  only  split  or  replicated  samples  can  be 
used  to  assess  tlie  accuracy  and  precision  of  most  biological 
samples. 


To  this  end,  five  sites  in  each  ol'  three  lakes  were  sampled 
repeatedly  in  order  to  estimate  the  importance  of  sampling  on 
dilTerent  dates  relati\'e  to  observed  dilTerences  among  the  five  sites 
in  each  lake.  By  comparing  samples  collected  on  the  same  day, 
samples  collected  each  week  and  samples  collected  every  six 
wveks,  the  report  established  when  dilTerences  among  the  fi\  e  sites 
within  a  lake  became  blurred  by  temporal  artifacts  associated  with 
sampling  on  different  dates.  Coefllcients  of  variation  were  used  to 
summarize  precision,  whereas  accuracy  was  estimated  by  a 
measure  of  repeatability  based  on  variance  components  from  an 
analysis  of  variance  (i.e..  ANOVA).  With  this  replicated  design 
and  the  use  of  variance  compoucuts.  the  QC  data  can  be  linked 
dirccth  to  field  data. 


From  this  assessment  the  LRTAP  sampling  protocol  proved 
to  ha\e  moderate  repeatabilitv'  and  precision  for  the  relative 
abundances  of  many  in\er1ebrate  ta.\a  when  samples  are 
collected  o\er  a  three-week  period.  These  major  groups  include 
aquatic  worms,  amphipods.  dragoullies.  aquatic  beetles,  most 
midges  and  clams.  By  contrast,  the  relati\'e  abundances  of  snails, 
k^^hes.  caddisflies  and  stoneflies  are  not  \'ery  useful.  In  addition, 
the  repeatability  and  precision  of  almost  all  of  the  ta.\onomic 
groups  becomes  unacceptable  if  samples  are  collected  every  six 
w  eeks  over  the  ice-free  season. 


1  he  de\  elopment  of  QA/QC  tools  for  biological  assessments  has 
far-reachmg  implications.  With  rigorous  QA/QC,  biological  data 
will  ha\e  the  same  credibility  as  chemical  data.  Morco\'er,  the 
greater  sensitivity  of  the  biological  data  will  enhance  our 
momtoring  capabilities.  Additionally ,  these  QA/QC  tools  can  be 
used  to  tine-ttme  the  various  biological  sampling  protocols  to 
ensure  that  pre-specified  aflects  can  be  detected.  For  instance. 
these  same  QA/QC  approaches  are  currently  used  in  an  ongoing 
Dorset  initiative  to  develop  rapid  bioassessment  methods  that 
pro\  ide  mexpensi\e,  accurate  biological  assessments  requiring  a 
minimum  of  taxonomic  expertise. 


Figure  1.    Ron  Ingram  completing  a  nearshore  substrate 
assessment  prior  to  sampling  the  benthic  invertebrates 


ITie  report  outlining  the  biological  QA/QC  protocol  and  associated 
analysis  was  published  in  the  Canadian  Journal  of  Fisheries  and 
.'\quatic  Sciences  (Reid,  R.A.,  K.M.  Somers  and  S.M.  David. 
1995.  Spatial  and  temporal  variation  in  littoral-zone  benthic 
invertebrates  from  three  south-central  Ontario  lakes.  Can.  J.  Fish. 
Aquat.  Sci.  52:  1406-1420). 
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